Geospatial data system for selectively retrieving and displaying geospatial texture data based upon user-selected point-of-view and related methods

ABSTRACT

A geospatial data system may include at least one geospatial database containing three-dimensional (3D) geospatial structure data and geospatial texture data associated with the geospatial 3D structure data. At least one geospatial data access device may also be included and comprise a display and a processor cooperating therewith for communicating remotely with the at least one geospatial database to retrieve and display a scene on the display based upon the 3D structure data and the geospatial texture data associated therewith. The geospatial data access device(s) may further comprise at least one user input device cooperating with the processor for permitting user selection of a point-of-view (POV) within the scene on the display with the POV determining revealed portions and obscured portions of 3D geospatial structures within the scene on the display. The processor may selectively retrieve geospatial texture data based upon the revealed portions and not the obscured portions.

FIELD OF THE INVENTION

The present invention relates to the field of modeling systems, and,more particularly, to geospatial modeling systems and related methods.

BACKGROUND OF THE INVENTION

Topographical models of geographical areas may be used for manyapplications. For example, topographical models may be used in flightsimulators and for planning military missions. Furthermore,topographical models of man-made structures (e.g., cities) may beextremely helpful in applications such as cellular antenna placement,urban planning, disaster preparedness and analysis, and mapping, forexample.

Various types and methods for making topographical models are presentlybeing used. One common topographical model is the digital elevation map(DEM). A DEM is a sampled matrix representation of a geographical areawhich may be generated in an automated fashion by a computer. In a DEM,coordinate points are made to correspond with a height value. DEMs aretypically used for modeling terrain where the transitions betweendifferent elevations (e.g., valleys, mountains, etc.) are generallysmooth from one to a next. That is, DEMs typically model terrain as aplurality of curved surfaces and any discontinuities therebetween arethus “smoothed” over. Thus, in a typical DEM no distinct objects arepresent on the terrain.

One particularly advantageous 3D site modeling product is RealSite® fromthe present Assignee Harris Corp. RealSite® may be used to registeroverlapping images of a geographical area of interest, and extract highresolution DEMs using stereo and nadir view techniques. RealSite®provides a semi-automated process for making three-dimensional (3D)topographical models of geographical areas, including cities, which haveaccurate textures and structure boundaries. Moreover, RealSite® modelsare geospatially accurate. That is, the location of any given pointwithin the model corresponds to an actual location in the geographicalarea with very high accuracy. The data used to generate RealSite® modelsmay include aerial and satellite photography, electro-optical, infrared,and light detection and ranging (LIDAR).

Another advantageous approach for generating 3D site models is set forthin U.S. Pat. No. 6,654,690 to Rahmes et al., which is also assigned tothe present Assignee and is hereby incorporated herein in its entiretyby reference. This patent discloses an automated method for making atopographical model of an area including terrain and buildings thereonbased upon randomly spaced data of elevation versus position. The methodincludes processing the randomly spaced data to generate gridded data ofelevation versus position conforming to a predetermined position grid,processing the gridded data to distinguish building data from terraindata, and performing polygon extraction for the building data to makethe topographical model of the area including terrain and buildingsthereon.

Nonetheless, topographical models are no longer reserved for advancedmodeling systems such as those discussed above. Various Internet serviceproviders such as Google™ and Microsoft® are looking to provide accessto 3D topographical models over the Internet that show users how a cityor location appears in as much realism as possible. This mayadvantageously help increase a user's awareness of a given area andprovide an exploratory environment. Such companies are striving toprovide environments that are easier to use, more realistic andultimately more useful. Improving the user experience involvesincreasing the quality of the 3D environment in terms of better terrain,more highly detailed city/building models, and higher resolution imageryof the terrain and buildings.

However, one significant challenge is that, while the terrain and modelsare quite small in terms of their geometries or structure, the imageryand textures used to enhance the basic models are typically very large.Over a high-speed network, such as that found within most corporatenetworks, downloading models and textures from a local network server isrelatively fast and therefore not particularly problematic. Over theInternet, however, downloading these quantities of data can be extremelyslow and significantly diminish user experience because of therelatively limited bandwidth available.

Currently, several network-enabled 3D viewers exist that permit users toview models from a network or Internet server. These viewers includeGoogle™ Earth, Microsoft® VirtualEarth, and NASA WorldWind. All viewersshare the ability to view untextured building models with some varyingdegree of textured terrain. Textured models tend to be very rudimentary.Microsoft® VirtualEarth attempts to apply textures over their models,but the delay can be so long as to become unacceptable to users.

Various approaches have been developed for remotely accessing terraindata. One example is set forth in U.S. Pat. No. 6,496,189 to Yaron etal. This patent discloses a method of providing data blocks describingthree-dimensional terrain to a renderer. The data blocks belong to ahierarchical structure which includes blocks at a plurality of differentresolution layers. The method includes receiving from the renderer oneor more coordinates in the terrain along with indication of a respectiveresolution layer, providing the renderer with a first data block whichincludes data corresponding to the coordinate(s) from a local memory,and downloading from a remote server one or more additional data blockswhich include data corresponding to the coordinate(s) if the providedblock from the local memory is not at the indicated resolution layer.Despite the existence of such approaches, further advancements may bedesirable for remotely retrieving and displaying large amounts ofgeospatial data.

SUMMARY OF THE INVENTION

In view of the foregoing background, it is therefore an object of thepresent invention to provide a system and related methods forefficiently retrieving and displaying geospatial data.

This and other objects, features, and advantages are provided by ageospatial data system that may include at least one geospatial databasecontaining three-dimensional (3D) geospatial structure data, and alsocontaining geospatial texture data associated with the geospatial 3Dstructure data. The system may further include at least one geospatialdata access device, which may comprise a display and a processorcooperating therewith for communicating remotely with the at least onegeospatial database to retrieve and display a scene on the display basedupon the 3D structure data and the geospatial texture data associatedtherewith. Moreover, the at least one geospatial data access device mayfurther comprise at least one user input device cooperating with theprocessor for permitting user selection of a point-of-view (POV) withinthe scene on the display with the POV determining revealed portions andobscured portions of 3D geospatial structures within the scene on thedisplay. Further, the processor may advantageously selectively retrievegeospatial texture data based upon the revealed portions and not theobscured portions of the 3D geospatial structures within the scene onthe display.

More particularly, the geospatial texture data contained in the at leastone geospatial database may be retrievable in successive additive layersof resolution, and the processor may therefore retrieve and display thegeospatial texture data in successive additive layers of resolution inthe scene on the display. Furthermore, the processor may prioritizeretrieval and display of successive additive layers of resolution ofassociated geospatial texture data to different 3D geospatial structureswithin the scene on the display. By way of example, the processor mayprioritize based upon relative distances of the 3D geospatial structureswithin the scene on the display. Also, the processor may prioritizebased upon different relative areas of the 3D geospatial structureswithin the scene on the display.

The geospatial data system may further comprise a communications channelcoupling the at least one geospatial database and the geospatial dataaccess device. The communications channel may have a capacityinsufficient to carry within a predetermined time all of the associatedgeospatial texture data for the 3D geospatial structures within thescene on the display. By way of example, the communications channel maycomprise the Internet. Additionally, the at least one geospatialdatabase and the at least one geospatial data access device maycommunicate using a streaming wavelet-based imagery compressionprotocol, such as the JPEG 2000 Interactive Protocol, for example.

A related geospatial data access method aspect may include storing 3Dgeospatial structure data and geospatial texture data associated withthe geospatial 3D structure data in at least one geospatial database.The method may further include remotely retrieving the 3D structure dataand the geospatial texture data associated therewith from the at leastone geospatial database. Additionally, a scene is displayed on a displaybased upon the retrieved 3D structure data and the geospatial texturedata associated therewith and also based upon a user selection of apoint-of-view (POV) within the scene on the display with the POVdetermining revealed portions and obscured portions of 3D geospatialstructures within the scene on the display. In particular, remotelyretrieving may further comprise selectively retrieving geospatialtexture data based upon the revealed portions and not the obscuredportions of the 3D geospatial structures within the scene on thedisplay.

A related computer-readable medium is also provided havingcomputer-executable instructions for causing a computer to perform stepsincluding remotely retrieving three-dimensional (3D) structure data andgeospatial texture data associated therewith from at least onegeospatial database, and displaying a scene on a display based upon theretrieved 3D structure data and the geospatial texture data associatedtherewith and also based upon a user selection of a point-of-view (POV)within the scene on the display. The POV may advantageously determinerevealed portions and obscured portions of 3D geospatial structureswithin the scene on the display. Remotely retrieving may furthercomprise selectively retrieving geospatial texture data based upon therevealed portions and not the obscured portions of the 3D geospatialstructures within the scene on the display.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram of a geospatial data system inaccordance with the invention.

FIGS. 2 and 3 are schematic block diagrams of the geospatial data systemof FIG. 1 in greater detail for a JPEG 2000 implementation.

FIG. 4 is a series of geospatial texture images illustrating progressivetexture data rendering of the system of FIG. 1.

FIGS. 5A-5C are another series of geospatial texture images alsoillustrating progressive texture data rendering of the system of FIG. 1.

FIG. 6 is a system flow diagram illustrating method aspects of theinvention.

FIG. 7 is a schematic block diagram of an alternative embodiment of thesystem of FIG. 1.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention will now be described more fully hereinafter withreference to the accompanying drawings, in which preferred embodimentsof the invention are shown. This invention may, however, be embodied inmany different forms and should not be construed as limited to theembodiments set forth herein. Rather, these embodiments are provided sothat this disclosure will be thorough and complete, and will fullyconvey the scope of the invention to those skilled in the art. Likenumbers refer to like elements throughout, and prime notation is used toindicate similar elements in alternate embodiments.

Referring initially to FIGS. 1-6, a geospatial data system 30 andassociated methods are now described. The system 30 illustrativelyincludes one or more geospatial data storage devices 31 containingthree-dimensional (3D) geospatial structure data, and also containinggeospatial texture data associated with the geospatial 3D structure dataand being retrievable in successive additive layers of resolution. Asused herein, “structure” data includes man-made (e.g., buildings,bridges, etc.) data, and the 3D geospatial structure data may be in theform of a DEM, such as a tiled triangulated irregular network (T-TIN),for example. The geospatial texture data may be optical (i.e., image)data, for example, that is used to overlay or texture the DEM, etc., tomake the image appear more realistic, as will be appreciated by thoseskilled in the art. In the example of FIG. 2, the geospatial datastorage device 31 is implemented in an Internet model library server 39,as will be appreciated by those skilled in the art.

The system further illustratively includes one or more geospatial dataaccess devices 32 for remotely accessing the geospatial data storagedevice(s) 31, such as via a wide area network 33, which in theillustrated embodiment is the Internet. The geospatial access device 32illustratively includes a display 34 and a processor 35, such as thecentral processing unit (CPU) of a personal computer (PC) or Macintoshcomputer, for example, although other types of processors (workstations,personal digital assistant (PDA) devices, laptops, etc., may also beused). In the example illustrated in FIG. 2, the geospatial accessdevice 32 is an Internet-enabled device.

Generally speaking, the processor 35 runs a viewer program 60 thatcooperates with the display 34 for communicating remotely with thegeospatial data storage device 31 to retrieve and display a scene on thedisplay based upon the 3D structure data and the geospatial texture dataassociated therewith. As discussed above, when retrieving high volumesof geospatial texture data over a relatively limited bandwidthcommunications channel, such as the Internet (compared to a local highspeed network connection, for example), this can make rendering of ageospatial scene or model on the display 34 very cumbersome andfrustrating for the user. Stated alternatively, the communicationschannel (e.g., the Internet) may have a capacity insufficient to carrywithin a predetermined time (i.e., the time the processor 35 couldotherwise render the scene) all of the associated geospatial texturedata for the 3D geospatial structures within the scene on the display34.

Typically, the transfer of 3D geospatial structure data will berelatively fast due to its smaller file size (e.g., on the order ofkilobytes), and can therefore be substantially immediately sent anddisplayed upon request from the geospatial data access device 32. On theother hand, the geospatial texture data can be on the order of severalmegabytes or larger, for example, which delays the rendering of thegeometry and the processor 35 otherwise waits until all data isretrieved to begin the rendering process.

Rather than compromise the geospatial texture data (and thus theultimate image) by reducing the resolution, or using smaller sizesynthetic textures that can provide false or misleading images, thegeospatial texture data is advantageously retrieved and displayed insuccessive additive layers 36 a-36 d of resolution (i.e., it is“streamed” in layers). This may advantageously make the user experiencemore interactive as model textures progressively sharpen as the usernavigates through a geospatial model/scene, as will be appreciated bythose skilled in the art.

More particularly, within the past several years, a wavelet-basedimagery compression technology known as JPEG 2000 has been establishedand standardized that decreases the data required for a given image. Asection of this specification enables imagery streaming, known as JPEG2000 Interactive Protocol (JPIP) under part 9 of the specification,which is hereby incorporated herein in its entirety by reference. In thesatellite imagery markets, this technique may allow users to effectivelybrowse images that are several Gigabytes in size over connections asslow as 16 kB/sec.

Applicants have discovered that if the JPIP technique is applied tomodel textures, this effectively enhances the user experience byreducing the amount of data necessary to texture a model in varyingresolutions. Streaming textures is a different approach than the currentmethod of downloading full-resolution textures (or multiple textures ofvarying resolutions), which takes advantage of the more efficient andinteractive protocol noted above.

In accordance with one embodiment, the effective user experience mayinclude loading of untextured models, followed by textured models thatprogressively increase in resolution as the user approaches buildings orother objects within the scene (i.e., changes the point-of-view (POV)).In other embodiments, the viewer program may use whichever texture isavailable, and the user might not ever see an untextured model. Forexample, if the client-software requests both the structure and thetexture data and the texture stream arrives first, the user would notsee the untextured model. The viewer program will typically display thescene from an initial (startup) viewpoint (Block 61), and the user canchange the POV using any suitable user input device, such as theillustrated keyboard 38, a mouse, joystick, etc. (Block 62). Objectsthat are farther away are only rendered using lower resolutions of theimage (known as quality layers within the JPEG 2000 file), at Blocks63-64 as discussed further below. As the user moves closer to astructure(s) (i.e., zooms in the POV), the structure/geometry datatherefor is retrieved and displayed (Blocks 65-67), which may initiallybe without texture (or with only a first layer of texture). Successiveadditive layers of texture are then streamed in to increase the scene ormodel's appearance and displayed accordingly, as will be discussedfurther below. This technique may advantageously be leveraged overnetworks of modest bandwidth and in effect, makes very efficient use ofnetwork resources. As will be discussed further below, the additionaltexture data to be streamed may advantageously be selected based upon aposition or relative distance of a structure within the scene, and/orbased upon whether the data is revealed (i.e., visible) in the scene.

A system 30′ implemented using JPIP is illustrated in FIG. 3. In thisembodiment, geospatial texture data layers 36 a′-36 d′ are stored in adata storage device 31′ on the server 39′ in a JPEG 2000 format that isarranged in a manner that permits efficient streaming by a JPIPstreaming module 41′. As the rendering program on the processor 35′requests textures, a JPIP module 40′ translates the requests into JPIPrequests. Responses are returned in successive additive layers 36 a′-36d′, and each layer is converted to a texture.

A JPIP-aware model viewer can make successive texture requests, eachtime resulting in sharper and sharper textures, as seen in FIG. 4. JPEG2000 files may be encoded using profiles that produce quality layers. InFIG. 4, each of the layers 36 a-36 d represents a different JPEG 2000quality layer. Each quality layer contains a portion of each pixel'sinformation, and each successive layer adds to the previous ones toprovide progressively sharper pixels until the final layer contains theremaining information to complete the full resolution image, as shown.Another example is shown in FIGS. 5A-5C, in which three successiveadditive layers result in the illustrated buildings 51 going from havingan obscured surface with little window or picture definition (51 c), tothe well defined buildings 51 a having relatively crisp windowdelineation and a visible image of whales on the side of one of thebuildings.

Referring additionally to FIG. 7, in accordance with anotheradvantageous aspect models/scenes that are farther away from the userneed only receive lower resolution textures, and the user isadvantageously not burdened with downloading unnecessary texture data.That is, the processor 35″ may advantageously prioritize retrieval anddisplay of successive additive layers of resolution of geospatialtexture data to different 3D geospatial structures within the scene onthe display 34″ (Blocks 68-72). By way of example, the processor 35″ mayprioritize based upon relative distances of the 3D geospatial structureswithin the scene on the display, and/or based upon different relativeareas of the 3D geospatial structures within the scene on the display.Thus, for example, buildings/terrain that are closer in the scene wouldreceive more successive additive layers of resolution thanbuildings/terrain that is farther away in the scene.

Moreover, as will be appreciated by those skilled in the art, as theuser selects a given POV within the scene, the POV will determinerevealed portions (e.g., front of buildings) and obscured portions(e.g., back of buildings) of 3D geospatial structures and/or terrainwithin the scene on the display. Further, the processor 35″ mayadvantageously selectively retrieve geospatial texture data based uponthe revealed portions and not the obscured portions of the 3D geospatialstructures within the scene on the display 34″. Thus, further bandwidthsavings are provided by not downloading portions of the scene that arenot going to be displayed on the display 34″ anyway from the given POV.

The invention may also be embodied in a computer-readable medium havingcomputer-executable instructions for causing a computer, such as theprocessor 35, to perform the steps/operations set forth above, as willbe appreciated by those skilled in the art.

Many modifications and other embodiments of the invention will come tothe mind of one skilled in the art having the benefit of the teachingspresented in the foregoing descriptions and the associated drawings.Therefore, it is understood that the invention is not to be limited tothe specific embodiments disclosed, and that modifications andembodiments are intended to be included within the scope of the appendedclaims.

1. A geospatial data system comprising: at least one geospatial databasecontaining three-dimensional (3D) geospatial structure data, andcontaining geospatial texture data associated with the geospatial 3Dstructure data; and at least one geospatial data access devicecomprising a display and a processor cooperating therewith forcommunicating remotely with said at least one geospatial database toretrieve and display a scene on said display based upon the 3D structuredata and the geospatial texture data associated therewith; said at leastone geospatial data access device further comprising at least one userinput device cooperating with said processor for permitting userselection of a point-of-view (POV) within the scene on said display withthe POV determining revealed portions and obscured portions of 3Dgeospatial structures within the scene on said display, said processorselectively retrieving geospatial texture data based upon the revealedportions and not the obscured portions of the 3D geospatial structureswithin the scene on said display.
 2. The geospatial data system of claim1 wherein the geospatial texture data contained in said at least onegeospatial database is retrievable in successive additive layers ofresolution; and wherein said processor retrieves and displays thegeospatial texture data in successive additive layers of resolution inthe scene on said display.
 3. The geospatial data system of claim 1wherein said processor prioritizes retrieval and display of successiveadditive layers of resolution of associated geospatial texture data todifferent 3D geospatial structures within the scene on said display. 4.The geospatial data system of claim 3 wherein said processor prioritizesbased upon relative distances of the 3D geospatial structures within thescene on said display.
 5. The geospatial data system of claim 3 whereinsaid processor prioritizes based upon different relative areas of the 3Dgeospatial structures within the scene on said display.
 6. Thegeospatial data system of claim 1 further comprising a communicationschannel coupling said at least one geospatial database and saidgeospatial data access device; and wherein said communications channelhas a capacity insufficient to carry within a predetermined time all ofthe associated geospatial texture data for the 3D geospatial structureswithin the scene on said display.
 7. The geospatial data system of claim6 wherein said communications channel comprises the Internet.
 8. Thegeospatial data system of claim 1 wherein said at least one geospatialdatabase and said at least one geospatial data access device communicateusing a streaming wavelet-based imagery compression protocol.
 9. Thegeospatial data system of claim 8 wherein the streaming wavelet-basedimagery compression protocol comprises the JPEG 2000 InteractiveProtocol.
 10. A geospatial data access device for accessing at least onegeospatial database containing three-dimensional (3D) geospatialstructure data, and also containing geospatial texture data associatedwith the geospatial 3D structure data, the geospatial data access devicecomprising: a display; a processor cooperating with said display forcommunicating remotely with the at least one geospatial database toretrieve and display a scene on said display based upon the 3D structuredata and the geospatial texture data associated therewith; and at leastone user input device cooperating with said processor for permittinguser selection of a point-of-view (POV) within the scene on said displaywith the POV determining revealed portions and obscured portions of 3Dgeospatial structures within the scene on said display; said processorselectively retrieving geospatial texture data based upon the revealedportions and not the obscured portions of the 3D geospatial structureswithin the scene on said display.
 11. The geospatial data access deviceof claim 10 wherein the geospatial texture data contained in the atleast one geospatial database is retrievable in successive additivelayers of resolution; and wherein said processor retrieves and displaysthe geospatial texture data in successive additive layers of resolutionin the scene on said display.
 12. The geospatial data access device ofclaim 10 wherein said processor prioritizes retrieval and display ofsuccessive additive layers of resolution of associated geospatialtexture data to different 3D geospatial structures within the scene onsaid display.
 13. The geospatial data access device of claim 12 whereinsaid processor prioritizes based upon relative distances of the 3Dgeospatial structures within the scene on said display.
 14. Thegeospatial data access device of claim 12 wherein said processorprioritizes based upon different relative areas of the 3D geospatialstructures within the scene on said display.
 15. A geospatial dataaccess method comprising: storing three-dimensional (3D) geospatialstructure data and geospatial texture data associated with thegeospatial 3D structure data in at least one geospatial database;remotely retrieving the 3D structure data and the geospatial texturedata associated therewith from the at least one geospatial database; anddisplaying a scene on a display based upon the retrieved 3D structuredata and the geospatial texture data associated therewith and also basedupon a user selection of a point-of-view (POV) within the scene on thedisplay with the POV determining revealed portions and obscured portionsof 3D geospatial structures within the scene on the display; whereinremotely retrieving further comprises selectively retrieving geospatialtexture data based upon the revealed portions and not the obscuredportions of the 3D geospatial structures within the scene on thedisplay.
 16. The method of claim 15 wherein the geospatial texture datacontained in the at least one geospatial database is retrievable insuccessive additive layers of resolution; and wherein remotelyretrieving and displaying comprise remotely retrieving and displayingthe geospatial texture data in successive additive layers of resolutionin the scene on the display.
 17. The method of claim 15 furthercomprising prioritizing retrieval and display of successive additivelayers of resolution of associated geospatial texture data to different3D geospatial structures within the scene on the display.
 18. The methodof claim 17 wherein prioritizing comprises prioritizing based uponrelative distances of the 3D geospatial structures within the scene onthe display.
 19. The method of claim 17 wherein prioritizing comprisesprioritizing based upon different relative areas of the 3D geospatialstructures within the scene on the display.
 20. A computer-readablemedium having computer-executable instructions for causing a computer toperform steps comprising: remotely retrieving three-dimensional (3D)structure data and geospatial texture data associated therewith from atleast one geospatial database; and displaying a scene on a display basedupon the retrieved 3D structure data and the geospatial texture dataassociated therewith and also based upon a user selection of apoint-of-view (POV) within the scene on the display with the POVdetermining revealed portions and obscured portions of 3D geospatialstructures within the scene on the display; wherein remotely retrievingfurther comprises selectively retrieving geospatial texture data basedupon the revealed portions and not the obscured portions of the 3Dgeospatial structures within the scene on the display.
 21. Thecomputer-readable medium of claim 20 wherein the geospatial texture datacontained in the at least one geospatial database is retrievable insuccessive additive layers of resolution; and wherein remotelyretrieving and displaying comprise remotely retrieving and displayingthe geospatial texture data in successive additive layers of resolutionin the scene on the display.
 22. The computer-readable medium of claim20 further comprising prioritizing retrieval and display of successiveadditive layers of resolution of associated geospatial texture data todifferent 3D geospatial structures within the scene on the display. 23.The computer-readable medium of claim 22 wherein prioritizing comprisesprioritizing based upon relative distances of the 3D geospatialstructures within the scene on the display.
 24. The computer-readablemedium of claim 22 wherein prioritizing comprises prioritizing basedupon different relative areas of the 3D geospatial structures within thescene on the display.